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GUIDEUNES  FOR  RUNNING  GRASS  BENCHMARKS 

Mark  O.  Johnson 

U.S.  Army  Construction  Engineering  Research  Laboratory 
P.O.  Box  4005 
Champaign,  IL.  61824-4005 


ABSTRACT 

The  purpose  of  the  report  is  to  document  the  current  procedures  used  to 
conduct  system  performance  tests  (benchmariss)  for  computers  running  the 
Greogrsphic  Resources  Analysis  Support  System  ( GRASS) . 

1.  Introduction 

The  purpose  of  the  GRASS  benchmarks  is  to  provide  would-be  users  with  a  general  means  of 
comparison  between  the  many  systems  now  running  GRASS.  This  information  will  be  used  to 
compile  and  update  the  GRA^ Harduare  Configumtion  Guide^  and  will  be  featured  in  the  quar- 
teiiy  issues  of  GRASSClifjvigs.^  It  should  be  stressed  that  speed  is  not  the  sole  factor  in  decid¬ 
ing  w^iat  Eystem  best  suits  a  user's  needs.  Other  factors  to  consider  include,  but  are  not  limited 
to,  system  price,  cost  and  responsiveness  of  hardware  and  software  maintenance  services,  sys¬ 
tem  limitations,  and  upgrade  C£4)abilitie8. 

2.  Documenting  Machine  Spedficatioos 

The  following  information  should  be  provided  with  the  benchmark  results  to  describe  the  sys¬ 
tem  being  tested.  A  form  is  provided  to  record  this  information.  When  completed  you  should 
send  the  form  to  the  above  address. 


System  Name 

Industry  name,  model  number,  etc.. 
Configuration  Price 

list  price  of  system  configuration  being  tested. 
Processor 

What  type  (68030,80386,..)  and  how  many. 


Floating  Point  Processor 

What  type  (68881,...)  if  any. 


1  Douglas  A.  ftooks,  Michael  E.  Higgins,  and  Math  O.  Johnson,  GRASS  Hanium  Configuration  Guide, 
ADP  Report  M-89/21  (U.S.  Army  ConstnKtaon  Engineering  Research  Laboiatoiy  [USACERL],  March 
1989). 

^  GRASSCIgfingt,  ISSN  0899-7853,  published  quaiteriy  by  the  GRASS  Inter-Agency  Steering  Committee. 
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Memory 

Amoimt  (in  megabytes)  of  RAM  memory  instaUed. 

Maodmum  amount  (in  megabytes)  of  RAM  memory  expansion  possible. 

Disk  Brand,  Size^  and  Access  Speed 

Brand  name  of  disk  (P\ijitsu,  Hitachi,...) 

Disk  size  ( in  megabytes) 

Disk  access  speed  claimed  by  manufacturer  (in  microseconds  [ms]) . 

Oock  Speed 

CPU  speed  in  megahertz  (  Mhz). 

Graphics  System 

Description  of  graphics  system  including,  but  not  limited  to,  such  things  as  industry 
known  name,  number  of  planes,  number  of  buffers,  number  of  colors  supported  (palette 
&  di^layable) .  This  will  be  condensed  to  fit  space  available. 

Screen  Resolntian  &  Size 

If  the  full  screen  will  be  used  as  the  graphics  window  specify  screen  resolution.  If  using  a 
sub- window  for  graphics,  specify  the  size  (in  pixels)  within  the  sub-window. 

3.  Setting  up  System  Ekivinsunent  for  Bencfamarks 

The  purpose  of  these  tests  is  to  determine  ^(hat  a  normal  user  should  expect  in  terms  of 
response  time. 

The  following  conditions  should  be  maintained  during 
testing: 

-  NO  SYSTEM  OPTIMIZING:  ALL  normal  system  daemons 
and  processes  should  be  active. 

-  NO  OTHER  USEIRS:  Be  sure  you  are  the  sole  user  of 
the  system  during  testing.  We  don’t  want  to 
measure  swap  time  between  you  and  another  user. 

However  the  system  should  be  in  multi-user  mode. 

-  SYSTEM  SHELL:  Use  whatever  shell  (csh.sh,..)  users 
are  normally  expected  to  use.  Most  users  tend  to 

use  the  csh-sheU  if  available.  Please  document 
your  choice  on  the  form  provided. 

4.  Setting  IV  G91ASS  Ekiviiaunent  ftr  Bencfamarks 

Enter  the  GRASS  system,  selecting  spearfish  as  your  location  and  any  name  you  choose  as  the 
mapset.  Once  you  have  a  GRASS  system  prompt  enter  the  following  command: 

Gwindow  default  print 

This  will  set  the  area  of  interest  and  the  resolution  to  match  those  of  the  spearfish  locations 
default  settings.  You  should  see  a  confirmation  like  this: 
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Mapset  <  benchmarks>  in  Location  <  spearfish> 
GRASS-GRID  >  Gwindow  default  print 


projection: 

1  (UTM) 

zone: 

13 

north: 

4928000.00 

south: 

4914000.00 

east: 

609000.00 

west: 

590000.00 

nsres: 

100.00 

ewres: 

100.00 

rows: 

140 

cols: 

190 

5.  Setting  iq>  GRASS  Graphics  Elnviranment  for  Benchmarks 

When  setting  up  the  gtEphics  environment,  be  sure  your  graphics  window  covers  the  entire 
screen.  If  you’re  running  the  grEphics  driver  within  a  window  management  system 
(suntools,X,...)  either  make  the  graphics  window  fill  the  screen  or  dociunent  the  size  (in  pixels) 
of  tile  graphics  window. 

6.  Operation  Descriptions 

'Riese  are  the  commands  to  be  used  for  benchmark  testing.  It  is  assumed  that  no  modifications 
have  been  done.  Any  modifications  should  be  completely  documented  and  returned  with  the 
benchmark  results. 

1)  Dcell  -  A  raster  data  display  function  involving  ditis.  1/  O  and 

raster  output  a^ch  is  used  to  fill  the  computer 
graphics  screen  with  a  data  layer. 

2)  Gstats  -  ftogram  involving  disk  I/O  and  up  to  4  byte  integer 

operations  to  calculate  the  frequency  of  common 
occurrence  of  categories  between  one  or  more  data  layers. 

3)  Dvect  -  A  vector  di^lay  function  involving  disk  I/O  and  vector 

output  aiiich  is  used  to  draw  vector  lines  from  a  data 
file  to  the  computer  graphics  screen. 

4)  Gslope.aspect  -  Program  to  create  slope  and  aspect  data  layers 

from  em  elevation  data  layer  involving  disk  I/O 
and  floating  point  computation. 


7.  Data  Description 

The  data  layers  geology  and  elevation  will  be  used  in  performing  tests  1,2,&  4.  The  geology 
data  layer  has  a  resolution  of  100  x  100  meters.  The  elen^on  data  layer  has  a  resolution  of  30 
X  30  meters.  DO  NOT  RESAMPLE  the  elevation  data  layer  to  fit  the  100  x  100  meter  win¬ 
dow.  The  vector  file  loads  will  be  used  for  the  Dvect  benchmark. 

8.  Benchmark  Ebcecution  Notes 

Ihe  UNIX  command  time  will  be  used  to  measure  the  q)eed  at  vtiiich  the  program  was  exe¬ 
cuted.  Ibis  command  returns  several  measurements  depending  on  the  version  of  UNIX  and  the 
type  of  shell  (sh  or  cah)  being  used.  The  tester  ahould  record  the  entire  line  returned  by  the 
time  command. 
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9.  Bencfamatk  Ebeecutian 

The  following  represent  examples  of  benchmark  execution  for  each  test  program. 

9.1.  DoeU 

Ma{}set  <  benchmarks>  in  Location  <  spearfish> 

GRASS-GRID  >  time  Dcell  elevation 

3.3u  3.4s  #  :#  #  15%  31-h  26k  294+  53io  Opf+  Ow 

9.2.  Gstats 

M^jset  <  benchmarks>  in  Location  <  spearfi8h> 

GRASS-GRID  >  time  Gstats  geology  elevation  >  gstat.out 
3.3u  3.4s  #  :#  #  15%  31+  26k  294+  53io  Opf+  Ow 

9.3.  Dvect 

M^jset  <  benchmaiks>  in  Location  <  ^arfi6h> 

GRASS-GRID  >  time  Dvect  roads 

3.3u  3.4s  *  ■**  15%  31+  26k  294+  53io  Opf+  Ow 

9.4.  Gslope: aspect 

M^pset  <  benchmatks>  in  Location  <  spearfi8h> 

GRASS-GRID  >  time  Gslope.aspect  elevation=  elevation  slope=  s.test  aspect=  a.test 
3.3u  3.4s  #  ;#  #  15%  31+  26k  294+  53io  Opf+  Ow 

The  tester  m^  want  to  remove  the  cell  files  created  by  Gslope.aspect  (s.test,  a.test)  and  the  file 
created  by  Gstats  ( gstats.out) . 
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G»ASS  BENCHMARK  INFORMATION  SHEET 
Sj^tem  Infonnation 
System  Name 
Ccnfiguration  Price 
Processor 

Floating  Point  Processor 
Memoty 

tested  system  amount 
maximum  amount: 

Disk  Brand,  Sizey  andAcoess  Speed 

Disk  brand  name: 

Disk  size: 

Disk  speed: 

Clock  Speed 
Gf^ducs  System 
Screen  Resolution  &  Size 
Shell  of  Chdoe 
Otha*  System  Information 

Description  of  other  standard  system  features  which  come  with  system  as  priced  (ethemet, 
racksize,  number  of  expansion  slots,  tape  systems,  manuals) . 
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Bencfamaik  Results 

Mapset  <  benchmarks>  in  Location  <  spearfish> 

GRASS-GRID  >  time  Dcell  elevation 
Enter  complete  time  results  here: 

Mfpset  <  benchmarics>  in  Location  <  spearfish> 

GRASS-GRID  >  time  Gstats  geology  elevation  >  gstat.out 
Enter  complete  time  results  here: 

Mfpset  <  benchmarks>  in  Location  <  spearfish> 

GRASS-GRID  >  time  Dvect  roads 
Enter  complete  time  results  here: 

Mapset  <  benchmarks>  in  Location  <  spearfish> 

GRASS-GRID  >  time  Gslope.aspect  elevation=  elevation  slope=  s.test  aspect=  atest 
Enter  complete  time  results  here: 
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